European Journal of Science and Mathematics Education 
Vol. 4, No. 1, 2016,1-16 


The impact of guided student-generated questioning on chemistry 
achievement and self-efficacy of elementary preservice teachers 

Christine Moseley 1 , Emily Bonner 1 , and Marilyn Ibey 2 

1 Department of Interdisciplinary Learning and Teaching, University of Texas at San Antonio, San Antonio, USA 

2 College of Sciences, Brown Mackie University, San Antonio, USA 
For correspondence: christine.moseley@utsa.edu 


Abstract 

This study investigated the use of Guided Student-Generated Questioning (GSGQ) as a metacognitive instructional 
strategy to increase chemistry achievement and self-efficacy of elementary preservice teachers. The Chemistry Self- 
Efficacy Scale (CSES), modified from the Biology Self-Efficacy Scale (BSES),was used to determine elementary 
preservice teachers' self-reported confidence in understanding chemistry. Findings indicated that GSGQ was 
significantly related to an increase in achievement for the topics of water and solubility but not for the topics of 
chemical reactions or matter. In addition, the use of GSGQ was found not to be significantly related to chemistry self- 
efficacy. 
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Introduction 

Inadequate content background in science (Franz & Enochs, 1982) has been cited by elementary 
teachers as a major obstacle to effectively teaching science. This is a concern given the 
increasing importance of, and demand for, scientific literacy and competency in today's society 
(Bandura, 1997). According to Stevens and Wenner (1996), 

Elementary teachers have been found to possess generally low level conceptual and 
factual knowledge as well as inadequate skills in the content area of science. General 
agreement exists that lack of such a background in science knowledge significantly 
contributes to hesitancy and possible inability to deliver effective science instruction 
in classroom settings, (p. 2) 

In addition, elementary teachers' attitudes towards science are important in determining both the 
quality and quantity of science taught to children (Mulholland & Wallace, 2001). Teachers have 
been shown to spend less time on subject areas, such as science, where their perceived self- 
efficacy is low (Enochs & Riggs, 1990). Thus, assessment of content-specific efficacy beliefs is an 
important consideration in understanding preservice teachers' competence in a subject. 

Several studies of preservice elementary teachers suggest that they generally have negative attitudes 
and a lack of confidence towards the teaching of physical science and chemistry concepts (Brigido, 
Bermejo, & Mellado, 2012; Johnston & Ahtee, 2006; Tosun, 2000; Yilmaz-Tuzun, 2008). These findings 
are relevant as negative beliefs about chemistry can lead to a dislike and avoidance of the subject 
(Danipog & Ferido, 2011).These negative attitudes may be related to a lack of understanding of basic 
concepts in chemistry and/or prior negative experiences in school (Ahtee & Johnston, 2006; Appleton, 
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2006; Johnston & Ahtee, 2006). Furthermore, preservice teachers often perceive chemistry concepts as 
largely abstract and, consequently, are unable to explain or apply them to real world situations (C^apa 
Aydin & Uzuntiryaki, 2009). 

Research also shows that attitudes about science influence abilities in science (Osborne, Simon, & 
Collins, 2003). For preservice teachers, this relationship between attitudes and achievement can 
impact how they will teach in their future classrooms (Ramey-Gassert, Shrover, & Staver, 1996). 
Several studies indicate that elementary preservice teachers are reluctant to teach science (Sherwood 
& Westerack, 1983; Wenner, 1993), and that self-efficacy is a significant factor contributing to this 
reluctance (Wenner, 2001; Baker, 1991; Riggs and Enochs, 1990). Teachers with low perceived science 
teaching self-efficacy do not feel comfortable about their ability to practice or teach science and may 
resort to avoiding science. In contrast, teachers with high self-efficacy tend to teach science and apply 
effective instructional strategies in the classroom (Avery & Meyer, 2012; Hechter, 2011).Thus, self- 
efficacy does influence how elementary preservice teachers view their role in the teaching of science 
and their potential success in that teaching (Finson, 2000). 

In addition, there are studies reporting a direct relationship between students' use of metacognitive 
strategies and their self-efficacy beliefs about their performance (Anderson & Nashon, 2007; Gourgey, 
2001; Kleitman & Stankov, 2007; Pintrich & De Groot, 1990; Pintrich & Garcia, 1991; Sungur, 2007). 
Gourgey (2001) stated that "metacognitive development might benefit not only their achievement, but 
their self-efficacy and motivation to learn as well" (p. 31).A review ofliterature also suggests there is a 
connection between effective metacognitive questioning strategies and academic achievement (Gall, 
1984; Redfield & Rousseau, 1981). 

Guided Student-Generated Questioning (GSGQ), a metacognitive questioning strategy, has proven to 
be effective in increasing student achievement (King, 1991; Rosenshine, Meister, & Chapman, 1996; 
Webb, 1989). However, little research has been done investigating the use of GSGQ with preservice 
teachers, especially at the elementary level. This study was designed to investigate how to improve 
elementary preservice teachers' academic achievement and efficacy towards the understanding of 
chemical concepts. More specifically, this study was conducted to investigate the impact of the use of 
GSGQ as a metacognitive instructional strategy on elementary preservice teachers' achievement and 
self-efficacy in chemistry. 

Theoretical Framework 

The premise that learning is socially constructed comes from the theory of social construction of 
knowledge whereby a person learns by revising old knowledge or constructing new knowledge with 
the help of peer interaction (Vygotsky, 1978). Information-processing theorists contend that students 
gain understanding when they construct knowledge or reconstruct existing knowledge with other 
students. This process allows new ideas to be associated with previous learning (Mayer, 1981,1984). 

According to Walsh and Sattes (2005), four aspects of learning - metacognition, question generation 
skills, attitudes, and self-efficacy - are interrelated. Guided Student-Generated Questioning (GSGQ) 
has been proven to be an effective metacognitive strategy in which students can formulate and 
answer content questions (Webb, 1989). Attitudes such as eagerness for knowledge and learning 
about the world foster student questioning and academic achievement. Self-efficacy is a person's 
confidence to carry out a task (Baldwin, Ebert-May, & Burns, 1998) and the power to affect an 
outcome (Scott, 1996). Metacognitive questioning not only facilitates student learning but it also 
supports student self-efficacy (Pajares, 1996). The definition of metacognition includes the self- 
efficacy features of personal reflection with respect to knowledge and affective states and the mental 
processes that aid in cognition (Paris & Winograd, 1990). 
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Social cognitive theory, a unified theory of behavior change, is concerned with human agency and 
how people exercise some level of control over their own lives. The theory states that an individual's 
behavior is primarily learned through his or her observations of others as well as through interactions 
with the environment (Bandura, 1977). An individual's belief in his/her ability in performing a task 
(i.e. learning chemistry) influences behavior, including the amount of time and effort expended to 
achieve a task and persistence when confronting obstacles towards the achievement of that task 
(Pajares, 1996).Generally, students with high levels of self-efficacy believe that they will succeed in a 
task while students with low self-efficacy believe they will be unsuccessful in accomplishing that task 
(Scott, 1996). Students with high self-efficacy establish greater expectations for themselves, use 
diverse strategies in problem solving, and persevere longer to meet their goals (Bandura, 1997; 
Bandura, Barberanelli, Caprera, & Pastorelli, 1996; Jinks & Morgan, 1999; Pajares, 1996; Scott, 1996). 
As such, an individual's ability to succeed in an academic setting is closely related to his/her self- 
efficacy towards a specific academic subject, such as chemistry. 

According to Bandura (1986), an individual's self-efficacy is influenced by four major sources of 
information:(a) prior experiences of mastery in performing a similar task, (b) vicarious learning 
opportunities wherein an individual sees another person similar in ability succeed at the task, (c) 
verbal persuasion by others to perform a task, particularly by a person who is competent in that task; 
and (d) emotional or physiological states while performing the task such as joy, stress, or fatigue. The 
effects of these four sources combined produce the overall self-efficacy of an individual in a given 
situation or context. 

Self-efficacy is content or task specific, meaning that one's level of perceived ability changes 
depending on the task or situation and influenced by the four sources within the context of the 
specific task (Tschannen-Moran, Woolfolk, & Hoy, 1998). As such, many researchers have 
demonstrated the direct relationship between self-efficacy and achievement in a given subject area 
(Hampton & Mason, 2003; Multon, Brown, & Lent, 1991; Pajares & Miller, 1994; Shell, Colvin, & 
Bruning, 1995). Specifically, scientific self-efficacy is predictive of scientific achievement (Andrew, 
1998; House, 1993). Typically, students with higher self-efficacy in their ability to understand 
scientific concepts are more likely to engage in learning science than students with low self-efficacy 
who may tend to avoid science (McMillan & Forsyth, 1991). Previous studies indicate that self-efficacy 
beliefs significantly predict academic achievement in physical science (Andrew, 1998) and chemistry 
(Fenel & Scheel, 2005; Kan & Akbas, 2006; Lalich, Taylor, & Pribyl, 2006; Zusho, Pintrich, & Coppola, 
2003). 

Pilot Study 

The goal of the research study was to investigate the use of GSGQ in impacting elementary preservice 
teachers' efficacy beliefs and academic achievement in chemistry. An initial review of the literature 
did not yield an established survey instrument to adequately address this goal. Thus, a new 
instrument, the Chemistry Self-Efficacy Scale (CSES), was developed by modifying an existing survey 
and piloted prior to the research study. 

The instrument development process involved the use of content expert feedback with respect to 
content and language of items within the survey and the use of appropriate reliability and factor 
analyses to examine the structure of the survey. Following standard measurement criteria for 
developing valid and reliable measures, the items on the CSES were subjected to expert reviews and 
pilot testing. 
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Chemistry Self- Efficacy Scale 

The Chemistry Self-Efficacy Scale (CSES) is a modification of the Biology Self-Efficacy Scale (BSES),a 
proven valid and reliable instrument that measures the biology self-efficacy of non-biology majors 
(Baldwin, Ebert-May, & Bums, 1998). In developing the BSES, an item pool was developed from an 
analysis of the literature in scientific literacy (American Association for the Advancement of Science, 
1990; Biological Science Curriculum Study, 1993; National Research Council, 1997; National Science 
Foundation, 1996). The domains of scientific literacy identify the aspects of science that individuals 
should know, do, experience, and value as citizens (Bybee, 1997). The BSES items chosen reflected the 
scientific domains of confidence in reading, summarizing, and critiquing biology concepts; writing 
and thinking with a scientific approach; and applying information learned in class to real-life 
experiences. 

The BSES consists of 23 items rated on a five-point Likert scale: 1 strongly agree to 5 strongly 
disagree. A principal factoring solution was used to analyze the underlying factor structure of student 
responses. Factor 1 represents the scientific domain of perceived confidence in writing and critiquing 
biological concepts, as well as using analytical skills. Factor 2 relates to perceived confidence in 
generalizing skills learned and using a scientific approach to solving problems. Factor 3 addresses the 
scientific domain of perceived confidence in an ability to apply biological concepts and skills to 
everyday events. Internal consistency reliability coefficients (Cronbach's alpha test) were found to be 
0.88 (Factor 1), 0.88 (Factor 2), and 0.89 (Factor 3) for the three domains of biological literacy (Baldwin, 
Ebert-May, & Bums, 1998). 

The Chemistry Self-Efficacy Scale (CSES) was modified from the BSES by substituting the words 
"chemical" or "chemistry" for "biological" or "biology." The CSES uses the same format as the BSES, 
a five-point reversed-scored Likert scale. Initially, a panel of three content experts with expertise in 
both chemistry and science education pedagogy reviewed the items on the CSES to assess content and 
face validity for instrument clarity and "offer concrete suggestions for improving the measure" 
(Rubio, Berg-Weger, Tebb, Lee, & Rauch, 2003, p. 95).The expert panel consisted of one university 
faculty in chemistry and two faculty in science education. Each panel expert was asked to review each 
item for clarity and relevance to the research and provide any additional feedback regarding how to 
improve items and the overall instrument. 

To further determine content, face, and construct validity and reliability, a pilot of the CSES survey 
was administered to 92 elementary preservice teachers the semester prior to the research study. A 
principal component factor analysis was performed to identify the underlying responses on both the 
pre-survey and the post-survey (see Table 1 for the pre-survey factor analysis and Table 2 for the 
post-survey factor analysis). Based on the psychometric properties of the BSES, the items on the CSES 
are grouped into the same three factor domains of the BSES. 

The first factor - Methods of Chemistry - contains eight items that refer to students' confidence in 
writing and analyzing their ideas in chemistry and utilizing analytical skills. For example. Question 
19 on the survey asks, "How confident are you that you could critique an experiment described in a 
chemistry textbook?" The second factor - Generalization to Other Science Courses and Analyzing Data - 
contains nine items that refer to students' confidence in generalizing skills acquired in a chemistry 
course and confidence in using a scientific problem-solving approach. For example. Question 8 asks, 
"How confident are you that you will be successful in this chemistry course?" The third factor - 
Application of Chemical Concepts and Skill- contains six items that refer to students' confidence in their 
ability to apply chemistry concepts and skills to everyday life. For example. Question 1 asks, "How 
confident are you that after reading an article about a chemistry experiment you could write a 
summary of its main points?" 
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Table 1. Factor Loadings for Exploratory Factor Analysis of CSES Pre-survey Components (Varimax 

Rotation) 


CSES Question 

Component 1 

Component 2 

Component 3 

1 

.270 

.624 

.300 

2 

.345 

.564 

.242 

3 

.208 

.777 

.159 

4 

.295 

.407 

.525 

5 

.018 

.467 

.594 

6 

.202 

.805 

.242 

7 

.189 

.328 

.800 

8 

.671 

.301 

.223 

9 

.284 

.649 

.284 

10 

.319 

.196 

.809 

11 

.733 

.265 

.243 

12 

.503 

.646 

.155 

13 

.597 

.145 

.583 

14 

.825 

.198 

.218 

15 

.491 

.465 

.346 

16 

.471 

.234 

.685 

17 

.790 

.235 

.114 

18 

.540 

.568 

.217 

19 

.629 

.467 

.306 

20 

.726 

.312 

.230 

21 

.430 

.620 

.237 

22 

.509 

.473 

.409 

23 

.228 

.622 

.464 


Table 2. Factor Loadings for Exploratory Factor Analysis of CSES Post-survey Components (Varimax 

Rotation) 

CSES Question 

Component 1 

Component 2 

Component 3 

1 

.656 

.312 

.317 

2 

.507 

.340 

.495 

3 

.436 

.553 

.307 

4 

.724 

.342 

.386 

5 

.496 

.633 

.092 

6 

.405 

.687 

.246 

7 

.778 

.328 

.162 

8 

.575 

.355 

.536 

9 

.593 

.494 

.316 

10 

.762 

.240 

.309 

11 

.377 

.365 

.638 

12 

.507 

.528 

.438 

13 

.560 

.375 

.480 

14 

.280 

.225 

.836 

15 

.352 

.717 

.280 

16 

.676 

.319 

.400 

17 

.316 

.205 

.810 

18 

.154 

.614 

.572 
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19 

.393 

.258 

.707 

20 

.219 

.508 

.673 

21 

.216 

.658 

.517 

22 

.367 

.661 

.323 

23 

.303 

.779 

.289 


Component 1 corresponded to Factor 2: Generalization to Other Science Courses and Analyzing Data, 
and had a percent of variance of 22.071 in the pre-survey scale and 24.577 in the post-survey scale. 
Component 2 corresponded to Factor 3: Application of Chemical Concepts and Skills, and had a 
percent of variance of 21.666 in the pre-survey scale and 23.835 in the post-survey scale. Component 
3 corresponded to Factor 1: Methods of Chemistry, and had a percent of variance of 26.726 in the pre¬ 
survey scale and 23.154 in the post-survey scale. 

The same three factors, including the same question items per factor as in the original BSES, loaded 
together after orthogonal rotation. These three factors were correlated to a moderate degree, but still 
remained independent constructs. These results suggest that the new CSES was valid for use in the 
research study and can be used as a tool in chemistry instruction for elementary preservice teachers. 

Internal consistency reliability coefficients of Factors 1, 2, and 3 were then determined using 
Cronbach's alpha test. The indices of reliability for Factors 1, 2, and 3 in the pre-survey were 0.91, 
0.92, and 0.89, respectively. The indices of reliability for Factors 1, 2, and 3 in the post-survey were 
0.92, 0.94, and 0.92, respectively. 

Research Study 

The research study was conducted the semester following the pilot study to investigate the impact of 
the use of GSGQ as a metacognitive instructional strategyon elementary preservice teachers' 
achievement and self-efficacy in chemistry. The Chemistry Self-Efficacy Scale (CSES)was used to 
measure self-efficacy, and the Chemistry Achievement Test constructed from questions on the state 
standardized science exam measured chemistry achievement. 

Participants 

The setting for the pilot and research studies was a large, urban, federally-recognized Flispanic- 
serving institution in the south central United States. The participants in the research study (n=72) 
included two convenient nonrandom groups of preservice elementary teachers (91% female; 75% age 
19-23; 52% Flispanic) enrolled in two sections of an undergraduate college physical science course for 
non-majors. Seventy-two participants completed both pre and post chemistry achievement tests 
(n=30/experimental group; n=42/control group) and 61 participants completed both pre and posttests 
of the CSES (n=28/experimental group; n=33/control group). 

To validate the use of the modified survey instrument, the CSES was piloted as a pre and post-survey 
to 92 preservice elementary education teachers enrolled in a required physical science course the 
semester prior to the research study. In order to ensure the validity and reliability of the pilot CSES, 
the similarities between the pilot and study groups were established. Table 3 displays demographic 
characteristics of the participants in both the pilot and research studies both and these data suggest 
that the populations were substantially similar. 




European Journal of Science and Mathematics Education Vol. 4, No. 1, 2016 


7 


Table 3. Demographic Characteristics as a Percentage of the Study Sample 
Characteristic Pilot Group Study Group 


N 92 72 

Gender 

Female 91.4 94.4 

Age 

19-23 years of age 75.3 76.4 

Ethnicity 

Non-Anglo 48.4 56.9 


Context of the Study 

The research study investigated the use of Guided Student Generated Questioning (GSGQ), a 
metacognitive questioning strategy involving socially constructed learning (King, 1991; Rosenshine, 
Meister, & Chapman, 1996; Webb, 1989). GSGQ involves giving students question stems or question 
starters that they individually answer and then share the questions with their peers in a small group 
setting. These question stems help students generate their own content questions at various cognitive 
levels (Cline, 2000). 

According to King (1992), GSGQ is an effective metacognitive strategy where connect new content 
and information with prior knowledge and experiences (Oakes & Lipton, 1999). GSGQ also involves 
peer-mediated learning, a process where "students attain higher levels of thinking when encouraged 
to develop skill in asking their own questions and when provided with more opportunities for 
dialogue with the classmates about the questions posed and conclusions derived from information" 
(Hunkins, 1976, p. 3). Thus, students are motivated to ask more complex questions of each other 
(Rosenshine, Meister, & Chapman, 1996). Explaining and defending one's thinking to peers improve 
the overall understanding of a concept as students have to elaborate and reorganize their thoughts to 
make them understandable (Bargh & Schul, 1980). 

The implementation of the GSGQ strategy in the research study occurred over a four week period and 
was embedded within the chemistry portion of a physical science course designed for elementary 
preservice teachers. The course includes the study of the fundamental laws that govern the universe, 
including mechanics, thermodynamics, electromagnetism, and quantum theory, and how these relate 
to physics and chemistry. Class discussions and activities are hands-on, inquiry-based, utilizing 
whole-group discussions, cooperative learning groups, and individual projects. Lecture and 
laboratory activities are integrated and designed around the learning cycle format (exploration, 
concept formation, and expansion), emphasizing the science process skills in discussions and 
demonstrations as they relate to the fields of physics and chemistry. 

One class section of the course was selected as the control group, using researcher-prepared 
chemistry questions. The other class section was selected as the treatment group, using student¬ 
generated chemistry questions from prepared question stems. In each of these two classes, the 
preservice teachers were randomly grouped into triads. The same instructor taught both sections of 
the course. The only difference in instruction between the control and treatment groups was the 
procedure used to develop the chemistry discussion questions. The lectures, class activities, and 
demonstrations were exactly the same in both groups for the same amount of time. The questioning 
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sessions were done at the end of the lesson in each group. The question stems in the control group 
were developed into complete content questions by the researcher prior to the topic lecture, whereas 
the same question stems were developed into complete content questions by the preservice teachers 
in the treatment group. 

The instructor who taught both class sections was initially trained by the researcher in the 
questioning review procedures to ensure that the study was conducted consistently and 
systematically. Then, the preservice teachers in both classes, facilitated by the same instructor, 
practiced the questioning review procedures for one hour to become familiar with the routine. 
Beginning the following week for one three-hour class session per group per week for the next four 
weeks, a different topic in chemistry was taught identically in both classes. The four chemistry topics 
selected were matter, chemical reactions, solutions and water. Each week, the preservice teachers, in 
groups of three, followed the topic lecture with one of the questioning review activities: GSGQ 
strategy for the experimental class and researcher-prepared questions for the control class. 

In the class with the prepared questions (control group), each triad participant received three of nine 
prepared questions at random. Then the preservice teachers individually answered (in writing) their 
three questions, using lecture notes if needed for reference. After all the answers to the prepared 
questions were completed, each group member posed the three questions orally to the other group 
members to answer and discuss. In the class using GSGQ (treatment group), each participant of the 
triad received three question stems at random. Each preservice teacher individually created, 
answered in writing, and shared with group members three content topic questions from the given 
question stems, using the provided lecture notes if needed for reference. In both the control and 
treatment group, students were given 20 minutes to develop, answer, and share the questions. 
Students in each group were allowed to give feedback to the peer presenter and ask further questions 
of the presenter for clarification. 

In both class sections prior to the study, the preservice teachers were trained in how to generate 
questions from the following given question stems: 

• How would you make use of _? 

• How does _ apply to _? 

• Predict what ivould happen if _. 

• Why do you think _? 

• What is the reason for _? 

• What relationship exists between _? 

• How would you test _? 

• What is the significance of _? 

• What is the most important _? 

The following questions from the lesson on Solubility provide an example of the two types of 
questioning strategies. A preservice teacher in the GSGQ class generated the following question from 
a stem (bolded): What relationship exists between polar/ionic and nonpolar solutes and solvents ? Then 
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the preservice teacher responded to the question she created from the stem (underlined) with the 
following answer: The relationship is that they determine how much of the solute will dissolve in a solvent or 
whether the substance will dissolve at all. In contrast, a preservice teacher in the non GSGQ class was 
given the following researcher-prepared question using the same stem (bolded): What relationship 
exists between solute and solvent? The preservice teacher then responded to this researcher-generated 
question with the following answer: The solute is dissolved and the solvent does the dissolving. The open- 
ended questions generated by the preservice teachers from researcher-prepared questions stems in 
the GSGQ class and the researcher-prepared questions of the non GSGQ class were comparable in 
content and cognitive levels. 

Chemistry Achievement Test 

Academic achievement in chemistry was assessed by using sixteen questions from the state 
standardized science test. These questions include basic chemistry concepts that elementary 
preservice teachers seeking state teacher certification in early childhood to sixth grade need to know 
and understand. Four each of the sixteen questions relate to each of the subtopics of matter, chemical 
reactions, solubility, and water. 

The content validity of the Chemistry Achievement Test (CAT) is based on content alignment to the 
state science standards. The No Child Left Behind Act (NCLB) of 2001 required states to ensure the 
alignment of their assessment tests to the existing content curricula. Consequently, content specialists 
involving teachers, test development specialists, and state officials developed valid test item types, 
objectives, and guidelines 

The CAT, according to the state education department not only has content validity because it 
reasonably samples content from the state curriculum, but also concurrent validity because it 
reasonably relates to other measures of the same construct (Texas Education Agency, 2008). 
Concurrent validity was demonstrated in the Higher Education Readiness Study of 2007, the Pearson 
study of 2007, and the Grade Correlation Study of 2008. The correlation values for the Higher 
Education Readiness Study were 0.57 (SAT 1 verbal vs. state exam ELA), 0.79 (SAT 1 math vs. state 
exam math), 0.79 (ACT math vs. state exam math), and 0.58 (ACT English vs. state exam ELA). 

Data Collection 

The CSES and the CAT were used as pre/post surveys to assess any significant change in chemistry 
self-efficacy and academic achievement. The preservice teachers completed both pre-surveys one 
week prior to the first topic lecture. The two post-surveys were administered one week after the 
fourth lecture, which was five weeks after the administration of the pre-surveys. 

Data Analysis 

All data were analyzed using IBM SPSS Statistics for Windows Version 21.0 (2012). An independent 
samples t-test analysis between GSGQ and non-GSGQ participant groups' chemistry achievement 
and self-efficacy mean scores was conducted. Independent t-tests were also used to determine the 
change between the two groups on the three factors of self-efficacy and the four topics of chemistry 
content. 

The Nonequivalent Control Group Design (shown in Figurel) was used in this study (Wiersma, 1969). 
Both groups of participants were initially given two pretests - the CSES and CAT - to determine 
equivalence between the experimental and control groups. Then, only the experimental group was 
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given the treatment. After the treatment, both groups were given two posttests to determine the 
effect of the treatment on the experimental group. 


Group Pretest/Question Training Treatment Posttest 

Week 1 Weeks 2-5 Week 6 


Experimental OX O 

Control O - O 

Figure 1. Nonequivalent Control Group Design 

Results 

Validation of the CSES 

The participant groups of preservice elementary teachers in both the pilot study and the research 
study were similar in gender, age and ethnicity. In the pilot study, the CSES was found by principal 
component analysis with orthogonal rotation and Cronbach's alpha test to be a valid and reliable 
chemistry self-efficacy scale with similar component factors to the original BSES. The results of the 
pilot study suggested that the new CSES was valid for use in the research study and can be used as a 
tool in chemistry instruction and assessment for elementary preservice teachers. 

GSGQ and Chemistry Achievement 

There was no significant difference (p< 0.05) between the CATpretest mean scores of the non-GSGQ 
and GSGQ groups. However, there was a significant difference (p< 0.05) between the overall CAT 
posttest mean scores of non-GSGQ and GSGQ groups (see Table 4). The mean score of the CAT 
posttest of the experimental group taught with GSGQ was significantly higher than the mean score of 
the CAT posttest of the control group not taught with GSGQ. 


Table 4. Comparison of Posttest Chemistry Achievement between GSGQ and non-GSGQ Groups 


GSGQ 



non-GSGQ 


N 

M 

SD 

N 

M 

SD 

30 

55.50 

17.99 

42 

41.81 

18.41 


Note: equal variances assumed. 


The posttest mean scores for each chemistry topic were higher for the GSGQ group than the non- 
GSGQ group (see Table 5). However, for only the topics of solubility and water were the posttest 
mean scores of the GSGQ group significantly higher (p< 0.05) than the posttest mean scores of the 
non-GSGQ group. 

Table 5. Comparison of Mean Correct Answer Cognitive Posttest Topics Groups 
GSGQ non-GSGQ 


Topic 

N 

M 

SD 

N 

M 

SD 

t(df) 

Matter 

30 

3.07 

1.20 

42 

2.59 

1.23 

1.62(70) 

Ch. Reactions 

30 

1.97 

1.00 

42 

1.52 

1.06 

1.79(70) 

Solubility 

30 

2.30 

1.06 

42 

1.02 

1.09 

5.00(70) 

Water 

30 

1.80 

1.16 

42 

1.19 

1.04 

2.33(70) 
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GSGQ and Chemistry Self-Efficacy 

There was no significant difference (p< 0.05) between the overall self-efficacy mean scores of both 
groups (see Table 6). Also, there was no significant difference between the mean scores of the three 
factors of chemistry self-efficacy. 


Table 6.Comparison of Posttest Self-Efficacy Mean Scores between GSGQ and non-GSGQ Groups 


GSGQ 


non-GSGQ 

Factor 

N 

M SD N M SD t (df) 

Overall 

28 

60.86 17.7633 58.14 21.84 .527(59) 

Concept & Skill 28 

15.04 

4.93 33 15.79 5.41 -.563(59) 

Application 



Methods of 28 

21.29 

6.47 33 21.27 7.13 .007(59) 

Chemistry 



Generalization 28 

23.93 

7.31 33 24.18 8.08 -.127(59) 

& Analyzing Data 




Discussion and Implications 

The theoretical basis for the study on metacognitive questioning strategies and cognitive achievement 
is grounded in the idea that students gain understanding when they construct knowledge or 
reconstruct existing knowledge in a social construct (Mayer, 1981,1984). Incorporating metacognition 
into levels of questioning has resulted in the development of several successful metacognitive 
instructional questioning strategies that improve student achievement. Guided Student-Generated 
Questioning (GSGQ) is one of these strategies. 

This study quantitatively examined the effect of GSGQ on chemistry achievement and student self- 
efficacy of elementary preservice teachers enrolled in a required physical science college class. The 
metacognitive strategy was implemented in the experimental group and statistical analysis of 
pre/post cognitive scores and self-efficacy scores were analyzed for significant differences. 

For the elementary preservice teachers, GSGQ significantly increased overall chemistry achievement 
(p < 0.05) for the topics of water and solubility but did not cause a significantly increase in chemistry 
achievement for the topics of chemical reactions and matter. However, even though there was not a 
significant increase in the mean scores for the topics of chemical reactions and matter in the GSGQ 
group, the scores did increase from pre to post survey. The authors of this study agree with Bereiter 
and Scardamalia (1989) and Rosenshine, Meister and Chapman(1996) that GSGQ can be an effective 
instructional strategy to involve preservice teachers in their own learning, allowing them to focus 
attention on and regulate their learning processes (King, 1991). Preservice teachers should be 
encouraged to create their own relevant content questions from question stems rather than use 
teacher-generated questions. In this way, they can reflect on what content they understand, what 
they do not understand, and what they need to study (King, 1991). 

The findings of this study suggest that teacher educators could create learning environments that 
more effectively develop the metacognitive skills of preservice teachers in order to increase their 
chemistry achievement. In the literature, various researchers have documented that metacognition 
can be enhanced during classroom instruction (Adey, Shayer & Yates, 1989; Baird & Northfield, 1992; 
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Beeth, 1998; Georghiades, 2000). Guided instruction that facilitates metacognitive instructional 
processes can be used in the chemistry classroom to provide a student-centered learning environment 
in which preservice teachers have the opportunity to be more reflective about their own learning. 

There was no significant difference between the chemistry self-efficacy post-survey mean scores of 
both groups. The chemistry self-efficacy remained at a consistent "fairly confident" or moderate level 
(means between 60.96 and 69.43) throughout the study. In other words, the preservice teachers' 
beliefs about their ability to understand chemistry did not significantly increase in spite of increased 
achievement in chemistry. Moreover, each of the three self-efficacy factor mean scores showed no 
significant difference between the GSGQ and non-GSGQ groups. These findings contradict the 
literature on self-efficacy as a predictor of scientific achievement and need to be further investigated. 

Researchers have previously reported that student self-efficacy is a good predictor of academic 
achievement (Bandura, 1997; Britner, 2008; Gwilliam & Betz, 2001; Kupermintz, 2002; Schunk, 1996). 
Therefore, it is important to find instructional strategies that increase student self-efficacy. Several 
possible reasons that self-efficacy did not increase in this study could be related to the four 
informational sources of self-efficacy. Mastery experiences (Bandura (1997) tend to be the most 
influential as they provide the most authentic evidence of success. Bandura argues that information 
about self-efficacy derived from a performance will depend on aspects of the task and self-efficacy 
beliefs already held. It is likely that these elementary preservice teachers have had limited prior 
mastery experiences in chemistry. Efficacy beliefs already held are not easily changed, so that positive 
experiences that are inconsistent with existing beliefs tend to be minimized. 

Vicarious experiences also influence efficacy beliefs when individuals learn new knowledge or skills 
by observing others perform the task. This is especially true for activities in which individuals must 
assess their ability by comparing themselves with others. Self-efficacy is usually increased if one 
compares well against others and lowered if one compares less favorably with people in similar 
situations (Bandura, 1982). Self-efficacy is especially sensitive to vicarious experience in situations 
where people are inexperienced or uncertain about their own capabilities (Bandura, 1997). This might 
have been the case in this study, resulting in little change in efficacy. 

Two other sources of information influencing self- efficacy includesocial persuasion and affective 
state of mind. Social persuasion can have a negative effect on self-efficacy if feedback given to the 
individual is negative (Bandura, 1997). Authentic, truthful, and realistic encouragements tied to a 
specific learning experience lead people to exert greater effort and are thus, more likely to succeed 
(Pintrich, 2003). Affective state of mind refers to an individual's emotional state and can be used to 
judge personal capabilities in achieving a task. If individuals experience excessive nervousness, 
anxiety, or fear of failure, they are likely to doubt their ability to succeed (Bandura, 1997).In this 
study, there were opportunities for peer feedback, but this feedback may not have been positive 
enough to overcome prior negative attitudes and change beliefs. 

Another consideration in the lack of change of self-efficacy is the fact that only four topics in 
chemistry were addressed in this study, and these topics were addressed over a short period of time 
(4 weeks), with only one three-hour class period for each topic. Thus, more hands-on experiences over 
a longer period of time, encouragement by mentors, and repeated success in chemistry achievement 
for elementary preservice teachers are recommended and should lead eventually to greater 
confidence in learning chemistry concepts. 


Using the CSES to measure change in self-efficacy can provide chemistry educators and researchers 
with an assessment tool to determine which tasks and teaching strategies best increase chemistry self- 
efficacy. It can also be used by teacher educators to gain an understanding of their preservice 
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teachers' confidence in learning chemistry concepts and consequently, assist them in the planning and 
designing of curricula. 

Like Thomas, Pedersen, and Finson (2001), the authors of this study believe that changes in preservice 
teachers' personal chemistry self-efficacy beliefs are unlikely to occur "without a great deal of 
purposeful, systematic inquiry about their personal theories, beliefs, and practice" (p. 328). The CSES 
is offered as one methodological tool to assist preservice teachers in analyzing and reflecting on their 
personal beliefs about chemistry. According to Paris and Winograd (1990), this reflection has two 
benefits: "(a) it transfers responsibility for monitoring learning from teachers to students themselves, 
and (b) it promotes positive self-perceptions, affect, and motivation among students. In this manner, 
metacognition provides personal insights into one's own thinking and fosters independent learning" 
(p. 15). 

Future Studies 

As previously stated, self-efficacy is directly influenced by the four sources of information as related 
to a specific task. Thus, the context of the learning environment is important to the development of 
self-efficacy towards a subject and consequently, academic achievement in that subject. Topics for 
further investigation might involve the ways in which teacher characteristics impact self-efficacy 
among students. To what degree does the self-efficacy of the teacher towards the subject being taught 
impact the self-efficacy of the students? How does the classroom environment affect efficacybeliefs? 
What types of instructional methods promote positive self-efficacy beliefs? Cooperative learning, the 
use of higher level questions, article analysis, concept maps, position papers done in a group format, 
and daily classroom writing or speaking activities are instructional strategies known to be effective in 
increasing biology self-efficacy(Bandura, Barberanelli, Caprera, & Pastorelli, 1996). Research needs to 
be conducted to determine if these instructional strategies are also effective in increasing chemistry 
self-efficacy. 

Investigations into the relationships between personal efficacy and demographics, such as gender, 
age, grade level, and ethnicity are needed. This study involved a population of non-chemistry majors 
consisting of 90% females. The study done by Baldwin, Ebert-May, and Bums (1998), using the BSES, 
consisted of a 3:1 female to male ratio. To ensure that the CSES will function similar to the BSES, 
another study should be conducted with a higher percentage of male preservice teachers. 

In the present study, data were collected over a short period of time (five weeks). The relationship 
between self-efficacy beliefs and academic achievement in chemistry should be studied 
longitudinally. How do the efficacy beliefs of preservice teachers develop and change over time? 
How do efficacy beliefs influence elementary preservice teachers' future teaching efficacy regarding 
chemistry concepts? Further research should focus on ways to increase personal self-efficacy. A future 
qualitative study of students' perceptions toward chemistry related to this current study would give 
insight into the underlying effects of the four main sources of self-efficacy on chemistry achievement. 

According to Pajares (2003), "teachers and schools are responsible for helping students develop their 
competence and confidence as students progress through school." Bandura (1986) argued that: 

Educational practices should be gauged not only by the skills and knowledge they impart for 
present use but also by what they do to children's beliefs about their capabilities, which 
affects how they approach the future. Students who develop a strong sense of self-efficacy are 
well equipped to educate themselves when they have to rely on their own initiative, (p. 417) 

Teachers who provide children with challenging tasks and meaningful activities that can be mastered, 
support these efforts, believe in their students, and convey their beliefs help ensure that their students 
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will develop a strong sense of efficacy (Mills & Clyde, 1991). We think that teacher educators should 
do the same. Personal self-efficacy ultimately becomes a way of thinking. Because teachers are 
influential in helping their students develop the self-beliefs that will serve them throughout their 
lives, it is imperative that teachers themselves have a strong sense of accomplishment and self- 
efficacy in the subjects in which they teach. 

There are some limitations of the current study. First, this study relied on the data obtained by two 
surveys. Surveys are efficient tools to gather data from samples in a short period of time; however, 
they provide limited information about the participants' thoughts or beliefs. Observations and/or 
interviews could be used as sources of more in-depth data. Second, the sample size of the results 
limits the generalizability of the results. 
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